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Description 

[METHOD AND APPARATUS FOR 
CONVERTING TWO-DIMENSIONAL 
IMAGES INTO THREE-DIMENSIONAL 

IMAGES] 

Background of Invention 
[ooo 1 ] Field of the Invention 

[0002] The present invention relates to a method and apparatus 
for producing stereoscopic 3-D images from monoscopic 
3-D data and specifically to an automated method and 
apparatus for converting input monoscopic 3-D graphical 
data to stereoscopic 3-D images. 

[0003] stereoscopic image systems are widely used in the enter- 
tainment business and research applications to provide 
video displays in which viewers can view objects in three 
dimensional space with realistic depth perception. Gener- 
ally, stereoscopic image display systems display image 
pairs to the eyes of a viewer. These image pairs corre- 



spond to left and right views as seen by the left and right 
eye of the viewer. When viewed together, these image 
pairs cause the viewer to perceive a stereoscopic image. 

[0004] virtual stereoscopic images may be produced from im- 
ages formed by a computer-based 3-D modeling system. 
These systems are especially useful for viewing stereo- 
scopic virtual 3-D images, such as those produced by 
video-gaming applications. Such images are produced by 
specifying parameters for two camera views of the image, 
one corresponding to a left view and one corresponding 
to a right view. Typically, the camera parameters used to 
produce these left and right views correspond to a left and 
right eye view as seen by a viewer of the image. The left 
eye views are then fed to the left eye of the viewer and the 
right eye views are fed to the right eye of the viewer such 
that the viewer sees a 3-D stereoscopic view of the image. 

[0005] p r j or ar t stereoscopic display systems, however, often se- 
lect left and right stereo image views that do not ade- 
quately correspond to a viewer's left and right eyes, thus 
causing eye fatigue and resulting in a less realistic looking 
stereoscopic image. Furthermore, in order to produce 
stereoscopic images for applications such as video- gam- 
ing, it is necessary for a stereoscopic display system to 



automatically produce stereoscopic images from a contin- 
uous stream of 3-D graphical data. One problem with au- 
tomating this process, however, is eliminating image dis- 
tortion associated with differing application and video 
frame rates. 

[0006] Conventional stereoscopic display methods and apparatus 
are also hardware dependent in that they are designed to 
work with specific video display systems, by using hard- 
ware drivers designed to display images through specific 
video cards. For example, a conventional stereoscopic 
display method may work on a nVidia brand video card 
but not on a ATI brand video card. Furthermore, even 
within the nVidia cards the model GeForce 3 would work, 
but if a GeForce 3A was released then the driver must be 
modified in order for the stereoscopic display method to 
work with that particular card. 

[0007] Thus, there is a need in the art for a hardware indepen- 
dent method and apparatus for automatically converting a 
stream of 3-D monoscopic images into distortion-free 

3-D stereoscopic images. 
Summary of Invention 

[0008] An exemplary embodiment of the present invention in- 
cludes an automated method of converting monoscopic 



3-D graphical data into stereoscopic 3-D images. The in- 
vention is particularly useful for viewing 3-D video game 
images as stereoscopic 3-D images. The method includes 
inputting 3-D graphical data, extrapolating a left stereo 
image and a right stereo image from said 3-D graphical 
data, and combining said left and right stereo images to 
produce a stereoscopic image. The method includes ex- 
trapolating a left stereo image and a right stereo image so 
as to minimize distortion in the final 3-D stereoscopic im- 
age. Furthermore, the method of converting monoscopic 
3-D graphical data in stereoscopic 3-D images of the 
present invention is independent of the video display 
hardware used for viewing the images, and thus may be 
used with various display systems without modification. 
[0009] An exemplary embodiment of the present invention also 
includes an apparatus for converting monoscopic 3-D 
graphical data into stereoscopic 3-D images. The appara- 
tus includes an inputting means, for inputting monoscopic 
3-D graphical data, an analyzing means, for analyzing 
said 3-D graphical data for the presence of perspective, 
an extrapolating means, for extrapolating left and right 
stereo images, and a hardware independent stereoscopic 
image viewing means, for viewing said left and right 



stereo images as a single stereoscopic image. The appa- 
ratus further comprises an image extracting adjustment 
means, for adjusting the left and right stereo image ex- 
tracting parameters. 
[0010] These and other features and advantages of the invention 
will be better understood from the following detailed de- 
scription, which is provided in connection with the accom- 
panying drawings. 
Brief Description of Drawings 

[0011] FIG 1. is a block diagram showing the method of convert- 
ing monoscopic images into stereoscopic images accord- 
ing to the present invention; 

[0012] FIG 2. is a block diagram showing the method of extract- 
ing a left stereo image and a right stereo image from in- 
putted monoscopic 3-D graphical data; 

[0013] FIG 3. is a block diagram showing the method of minimiz- 
ing distortion of the stereoscopic image formed when a 
left stereo image and a right stereo image are combined; 
and 

[0014] FIG 4. is a diagram showing the configuration of an appa- 
ratus for converting monoscopic images into stereoscopic 

images according to the present invention. 
Detailed Description 



[0015] FIG 1. illustrates an exemplary method of the present in- 
vention by which monoscopic images are converted into 
stereoscopic images. Generally, the method comprises the 
steps of inputting monoscopic three-dimensional (3-D) 
graphical data, block 10, analyzing said monoscopic 3-D 
graphical data for the presence of perspective, block 12, 
extrapolating a left stereo image and a right stereo image 
from said monoscopic 3-D graphical data containing per- 
spective, block 14, outputting said left and right stereo 
images to an image display system via a hardware inde- 
pendent display method, block 16, and combining said 
left stereo view and said right stereo view to produce a 
3-D stereoscopic image, block 18. 

[0016] First, at block 10, monoscopic 3-D graphics data is in- 
putted, for example, by a 3-D computer graphics pro- 
gram. A software application can generate the incoming 
3-D graphics data stream by passing x, y, and z coordi- 
nates to a computer graphics rendering program such as 
OpenGL. OpenGL is a low-level graphics library specifica- 
tion that makes available to a programmer a set of geo- 
metric primitives (e.g. points, lines, polygons, images, 
bitmaps). OpenGL provides a set of commands that allow 
the programmer to specify geometric objects in two or 



three dimensions by using the provided primitives to- 
gether with commands that control how these objects are 
rendered into the frame buffer. While the exemplary em- 
bodiments of the present invention is not so limited, con- 
version of monoscopic images into stereoscopic images in 
accordance with the present invention can be achieved 
using any graphics rendering system that uses linear 
transformation or a projection viewing matrix, such as Di- 
rectX. 

[0017] | n t he second step of the first exemplary embodiment de- 
scribed above and shown at block 12, each set of 3-D 
graphical data representing a distinct scene is analyzed 
for the presence of perspective, indicating that the scene 
is intended to be viewed in 3-D. Normally, an application 
rendering the 3-D data stream sets the projection matrix, 
then switches the matrix mode to model view. When the 
matrix is switched out of projection mode, the current 
projection matrix is read and analyzed. If no perspective is 
found, it is assumed that the projection matrix is a pro- 
jection for 2-D rendering that is not part of the 3-D scene 
(e.g. status messages) and the matrix is not modified and 
is outputted to the image viewing system described be- 
low. 



[0018] Block 14 shows a third step of the first exemplary embod- 
iment described above in which the inputted monoscopic 
3-D graphics stream is modified to produce a left stereo- 
scopic image and a right stereoscopic image. Convention- 
ally, a 3-D graphics stream produced by a 3-D computer 
graphics program, as described above, is rendered to a 
2-D display system for viewing. According to the present 
invention, however, the inputted 3-D graphics stream is 
first modified into a left stereo image and a right stereo 
image, before being outputted to a display system for 
viewing. The present invention creates these left and right 
stereo images by selecting two separate camera views of 
the inputted 3-D graphics stream, one corresponding to a 
view as seen by the left eye of a viewer, the other corre- 
sponding to a view as seen by the right eye of a viewer. 
The left and right camera views are selected as described 
below. 

[0019] FIG 2 represents the method of determining the parame- 
ters from which left and right stereo images are extracted 
and output as shown in blocks 14 and 16 of FIG 1. While 
the following description may refer to creation of a left 
stereo image first and a right stereo image second, in ac- 
cordance with the present invention, either the left or 



right stereoscopic viewpoint can be generated first. First, 
at block 20, near and far depth limits are derived for lin- 
ear transformation or projection matrices in which per- 
spective is found. Next, at block 22, the apparent depth 
position of the screen (convergence point for the stereo 
view) is set as a fractional position between the near and 
far values, typically very close to the near Z coordinate 
(with a few objects appearing in the front of the screen) 
22. As shown at block 24, a skew is then added dynami- 
cally, normalized to the convergence point, to achieve ei- 
ther a left or right camera view 24. The skew, for example, 
can be initially set as the sine of the angle between the 
monoscopic view and the offset of one eye. The present 
invention, however, allows a viewer to manually adjust the 
skew according to the viewer's own comfort, as shown at 
block 26. 

[0020] The left and right stereo images are then outputted to an 
image display system via a hardware independent display 
method, block 28. For example, the extrapolated left and 
right stereo images do not require hardware specific soft- 
ware drivers to display the images through the video card 
of a display system, as described below. The exemplary 
method described here bypasses this requirement by at- 



taching its output to the openGL, directX, or similar ren- 
dering application being used. Since those applications al- 
ready have a direct output stream (i.e. they can be read by 
any display system), no additional software driver is nec- 
essary in order for the video display system to display the 
images. Thus , because left and right stereo images out- 
putted to a video display system according to the present 
invention are independent of the hardware used in the 
video display system, they can be displayed using any 
type of video card and need not be updated as each new 
video card model is released. 
[0021] | n accordance with the present invention, the left and 

right stereo images created at block 14 in FIG 1 are both 
created and outputted for viewing sequentially. For exam- 
ple, a left image of a given input scene is extracted first 
and outputted to the viewers left eye and as described be- 
low, followed by a right image of the same scene. Scenes 
in the form of monoscopic 3-D graphical data are contin- 
ually inputted and automatically converted to left and 
right stereoscopic images for viewing as a stereoscopic 
image as described. Thus, the steps in the method out- 
lined in FIG 1 repeat until the 3-D graphical data input is 
terminated. 



[0022] | n another exemplary embodiment of the present inven- 
tion, left and right stereo viewpoints are created sequen- 
tially from the incoming 3-D data stream, as described 
above, while allowing the application to redraw between 
creation of the left and right stereo views. According to 
this exemplary method of creating the left and right 
stereo views, the application frame rate must match the 
video frame rate (typically 120 frames/sec.) in order to 
avoid producing a final stereoscopic image that is dis- 
torted due to the time difference between each view. 

[0023] | n y e t another exemplary embodiment of the present in- 
vention, distortion of the final stereoscopic image is mini- 
mized by creating sequential left and right stereo images 
as described above, while storing a set of rendering com- 
mands for a given inputted scene in a DLL memory as 
shown in FIG 3. In step 1, block 30, monoscopic 3-D data 
representing a particular scene is inputted. Next, block 
32, a left stereo image is created from the incoming 3-D 
data, which is stored in a DLL memory, block 32. A right 
stereo viewpoint can then be created from the same 
stored 3-D data, as shown as block 34. Since both left 
and right stereo viewpoints are created from the same 
3-D data, distortion resulting from disparate application 



and video frame rates is eliminated. 

[0024] | n a fourth step of the first exemplary embodiment of the 
present invention described above and shown in block 16 
of FIG 1, the left and right stereo images are combined to 
produce a stereoscopic image. For example, left and right 
stereo images are sequentially outputted to a viewing sys- 
tem described below. 

[0025] Referring now to FIG 4, an apparatus for converting 3-D 
monoscopic images into stereoscopic images 40 com- 
prises a host computer 41, coupled to a monoscopic 3-D 
data inputting means 42, a means for analyzing said in- 
putted monoscopic 3-D data for the presence of perspec- 
tive 44, a means for extrapolating a left stereoscopic im- 
age and a right stereoscopic images 46 from said mono- 
scopic 3-D data having perspective, a hardware indepen- 
dent means for outputting the left and right stereoscopic 
images to a video display system 47, a user interface 48, 
and a means for viewing the left and right stereoscopic 
images such that they are perceived by the viewer as a 
3-D stereoscopic image 49. 

[0026] The host computer 41 may be a typical desktop PC and 
includes a CPU, memory, and device drivers (not shown) 
required to interact with the coupled devices. The mono- 



scopic 3-D data inputting means 42 may be any computer 
graphics rendering system that uses linear transformation 
or a projection viewing matrix. One example of such a 
system is any computer software application that pro- 
duces 3-D graphical information for viewing by passing 
3-D coordinates to the OpenGL library as described 
above. The perspective analyzing means 44, the left and 
right image extrapolating means 46, and the hardware in- 
dependent means for outputting the left and right stereo- 
scopic images to a video display system 47 are devices 
created by commands executed by the host computer ac- 
cording to the present invention as described above. The 
user interface 48, may be a keyboard, mouse, or any other 
type of user interface used in association with computer 
graphics. 

[0027] | n accordance with the second exemplary embodiment of 
the present invention, the means for extrapolating a left 
stereoscopic image and a right stereoscopic image 46 in- 
cludes a means for taking a left camera view and a right 
camera view of a scene generated by the input mono- 
scopic 3-D data from said data inputting means. As de- 
scribed above, the left and right stereoscopic images are 
derived by first deriving near and far depth limits for a 



given image and then setting the apparent depth position 
of the screen (convergence point for the stereo view) to a 
fractional position between the near and far values, typi- 
cally very close to the near Z coordinate (with few objects 
appearing in front of the screen). A skew is then added 
normalized to the convergence point, to achieve either a 
left or right camera view. The skew, for example, can be 
initially set as the sine of the angle between the mono- 
scopic view and the offset of one eye. The present inven- 
tion, however, allows a viewer to manually adjust the skew 
according to the viewers own comfort via the user inter- 
face 48. 

[0028] The means for viewing 49 the left and right stereoscopic 
images such that they are perceived by the viewer as a 
3-D stereoscopic image may comprise a video card and 
video monitor and 3-D viewing glasses or by auto- 
stereoscopic displays (glasses-free), all of which are well 
known in the art. Using auto-stereoscopic displays, the 
user would not need glasses to filter the left eye view and 
the right eye view. The monitor screen would perform the 
filtering actions, although the viewing method is the same 
sending one view to each eye. Exemplary video cards in- 
clude, but are not limited to, nVidia and ATI brand cards. 



Exemplary monitors include any monitor capable of dis- 
playing images from 3-D graphical data. Exemplary 3-D 
glasses include eDimensional"s E-D glasses, which are 
worn by the viewer. Essentially, output of the left and right 
stereo images to the monitor via the video card and the 
action of the 3-D glasses is synchronized in order to pro- 
duce a stereoscopic 3-D image. For example, the left 
stereoscopic image outputted to the monitor is displayed, 
while the right lens of the 3-D glasses is simultaneously 
made opaque such that only the viewer's left eye sees the 
left stereoscopic image. The step is then repeated for the 
right stereoscopic image and alternates between left and 
right at the scan rate of the monitor such that the viewer 
appears to simultaneously see the left and right stereo 
images of a given inputted scene and perceives a stereo- 
scopic 3-D image of the scene. Furthermore, the means 
for outputting the left and right stereo images to the 
video card is independent of the video card used in the 
video display system and thus, as described above, may 
be used with various video display systems without modi- 
fication. 

[0029] while exemplary embodiments of the invention have been 
described and illustrated, various changes and modifica- 



tions may be made without departing from the spirit or 
scope of the invention. Accordingly, the invention is not 
limited by the foregoing description, but it only limited by 
the scope of the appended claims. 



